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ABSTRACT 

The present study was designed to replicate findings 
concerning the effect of question position on retention of practiced 
and non-practiced information and to further evaluate the robustness 
of the mathemagenic concept by comparing the effectiveness of 
subject-generated pictures as adjunct aids with written multiple 
choice questions. The subjects were 63 undergraduate students from 
three introductory educational psychology courses. The following 
hypotheses were tested: performance on practiced questions will be 
significantly higher than on non-practiced questions; where adjunct 
aids appear after textual passages, performance will be significantly 
higher than where they appear before those passages; those groups 
with pictorial adjunct aids will perform at least as well or better 
than those groups with written adjunct aids; and all experimental 
groups will significantly outperform the control group on practiced 
questions. Of the four hypotheses tested^ the first three were fully 
supported and the fourth was partially supported. (Author/RB) 
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A COMPARISON OF PICTORIAL AMD WRITTEN ADJUNCT 
AIDS IN LEARNING FROU TEXT 
Jack Snowman and Donald J. Cunningham 

Rothlcopf (1966, 1967, 1970), Erase (1968, 1970) and others (e.g., 
Keller & Ctanningham, 1972; Cunningham & Keller, 1972) have show that the 
insertion of test-like questions in textual passages can alter reading 
behavior by modifying ihe stimulus value of the text. Generally, these 
studies have shown that the insertion of questions in a passage results in 
increased retention of material directly covered by these questions (prac- 
ticed retention) as compared to unquestioned controls. Additionally, 
questions inserted just a£ter a specified passage aid retention of material 
not directly covered by these adjunct questions (non-practiced retention) 
as cornpared to questions before and (perhaps) as compared to unquestioned 
controls, although this latter point is currently a point of controversy 
(Ladas, 1973) • Rothkopf has proposed that data such as these are best 
interpreted under a ruberic he labels "mathemagenic behaviors," the study 
of behavior which influences learning. 

Since Rothkopf 's initial work in the area, a number of variables such 
as question frequency, question type, instructional set, etc. have been 
examined in order to test the robustness of the phenomena (see Erase, 
1970 for a review). The theoretical bases and methodological techniques 
used by researchers in this area have come under increasing criticism 
recently (e.g.. Carver, 1972 Ladas, 1973) but general agreement does seem 
to have been attained conceraing the importance of the behaviors under 
investigation and the potential of investigations in this area to offer 
insights into the instructional process. 

The use of pictorial materials within a mathemagenic^ framework has 
not as yet been attempted possibly because previous research seeking 
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enhanced retention of connected discourse as a function of pictorial stimuli 
has been inconclusive (see Carroll, 197l)» However there is evidence to 
suggest that when pictures require the same type of information processing 
as their semantic analogue they may facilitate retention (Matz & Rota/er, 
1971). Levin (1973), in failing to replicate the results of Matz and 
Rohwer (1971), speculated that his pictorial materials may have been less 
than ideal representations of the stories. Additionally, he felt that some 
kind of linguistic accompaniment to the pictorial materials was necessary 
noting the presence of this featiu:e in the Matz and Rohwer (1971) fltudy. 

The mathemagenic framework appeared to lend itself easily to these 
considerations. Pictures could serve the same purpose as questions - as 
devices to induce rehearsal or memory search - and could be employed withrm 
a basically linguistic context. 

The present study was designed, then, to replicate previous findings 
concerning the effect of question position on retention of practiced and 
non-practiced information and to further evaluate the robustness of the 
mathemagenic concept by comparing the effectiveness of subject generated 
pictures as adjunct aids with written multiple choice questions. It was 
decided to have the Ss generate their own pictures rather than have E 
supply them for two reasons. First, it more closely paralleled the treat- 
ments v/here questions were used in that S had to make an overt response. 
Second, as Anderson (19^7) has pointed out, leaming is facilitated when 
overt, constructed responses are made provided that the response is relevant 
to what is to be learned. 

The foJJLowing hypotheses were proposed: (l) Performance on practiced 
questions will be significantly higher than on non-practiced questions, (2) 
Where adjunct aids appear after a textual passage, performance will be 
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significantly higher than where they appear before those passages* (3) 
Those groups with pictorial adjunct aids will perform at least as well or 
better than chose groups with written adjunct aids# {k) All experimental 
groups will significantly outp^^rform the control group on practiced ques- 
tions • 

In addition to the groups receiving either written or pictorial adjunct 
aids there were two additional groups whose treatment included both types 
of adjunct aids, one with the adjunct aids before, one with them after the 
relevant text. The decision to include these two groups was made in order 
to evaJ.uate the possibility of an additivlty of adjunct aids. Due to the 
exploratory nature of this treatment no hypotheses were advanced concerning 
the performance of subjects in these groups • 

ME THOD 

Materials 

A 2,189 word passage describing a fictitious tribe in a fictitious 
country in east centre! Africa was used. The material was assernbled in 
booklets of 20 pages. Fach page was 8|- x 5^ inches and contained two 
paragraphs of text. Each paragraph contributed one four alternative 
multiple-choice question to t.he criterion test which required the recall 
of specific factual infornation from that paragraphs The questions were 
constructed so as not to overlap in content. Item arrangement on the test 
was random. Each subject, except the controls, received a booklet that 
had wither written adjunct questions, a direction to sketch a picture, or 
both (the direction to draw occuring first on one page and the question 
following on the next page). The direction to sketch a picture was simply 
a restatement or the corresponding question into imperative form (without 
the alternative answers, of course). Within each of these three types the 
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adjunct aid (question, instruction to draw, or both) appeared either immediately 
'bGJJ^Ore^Dr fiSSj^ir each page of text . Including the control group this resulted 
in seven versions of the booklet. These -were designated as QB (question 
before, (question after), PB (picture before)^ PA (picture al^er), BB 
(both before), BA (both after), anJ C (Control). 

Those questions or directions to draw which were interspersed through- 
out the text were randomly selected with the restriction that of the 
twenty paragraphs from vrhich they were derived, ten were to be drawn from 
the first paragraph and ten from, the second. These questions were designated 
as practiced (P) itsms. The remaining twenty automatically became the 
non-practiced (UP) items. 

The criterion test was validated on a separate sample from the same 
population. Kuder -Richardson reliability was .85 and Spearmen-Brown 
reliability was .81. 

Subject s 

The Ss were sixty-three undergrade late student g from three introductory 
educational psychology courses at Indiana University. Subjects were run 
in their classes with assignment to treatment randomised within class 
and V7ith the restriction of equal cell sizes. 

Design and Procedures 

The design of the experiment constituted a 3 x P. x 2 factorial with 
repeated neasures on the last factor. !^ype of adjunct aid (question, 
picture, or both) and position (before or after) were between subject 
factors. Scales (practiced and non -practiced) was the within subjects 
factor. Before beginning, all Ss were instructed to carefully read the 
directions attached to their booklet explaining the nature of the task. 
They were allowed to work through the booklet at their own rate but were 



not allowed to review. Subjects were also requested tc record the time 
at which they started and finished. Immediately after completing the 
booklet the criterion test was administered. 

RESUL TS 

Tlie initial analysis was carried out by means of two separate analyses 
of variance, one \?ithout the control gi'oup and one with the control group. 
The analysis without the control group constituted a 3 x 2 x 2 factorial 
as outlined in the design section. As Table 1 indicates, no differences 
were observed between treatment groups with respect to type of adjunct 
pid (FcI, df=2/kS) . The ejcpected advantage of having the adjunct aid 
appec. / immediately after the textual passage as opposed to before, was 
observed (F=U.92, df=l/U8, p <.05). The advantage of the P over the NP 
items, which has also be en previously demonstrated, was reliably replicated 
(F=129,57, df=l/I+8, p<.OCl). The significant Position x Scales inter- 
action (F=7.63, df=l/l+8, p <.0l) that appears in Figure 1 was not unexpected 
as it has appeared in previous research of similar design (Keller & 
Cunningjiam, 1972). Inspection of this interaction reveals no position 
advantage with P items but adjunct aids appearing immediately after text 
segments produced increased retention of NP items. 

The analysis which included the control group constituted a 7 x 2 
factorial. The only additional finding of interest in this analysis was 
a significant Tirpes x Scales interaction (Fk7»H6, dfK6/56, p <.05) which 
has been depicted as a histogram in Figure 2 for purposes of clarity. 
This interaction shows that with P items the six treatment groups retained 
mere than the control group whereas with UP items only those who received 
the adjunct aid after the reading passage retained more than the control 
group. However, a Dunnett*s test, with P items as the dependent measure. 



revealed that only the group significantly outperformed the control 
group (p<.05). With NP items as the dependent measure the Dunnett's 
test revealed no significant differences between any of the experimenteil 
groups and the control group. Thus, while the data are in the predicted 
direction, the predicted differences do not achieve conventional levels 
of significance. 

Since half of the P and NP items were derived from the first para- 
graph of text while the remlning half were derived from the second para- 
graph, it was possible to analyze the effect of this location factor on 
recall. Since this analysis had produced some interesting result^ in 
earlier research (e,g,, Cunningham & Keller, 1972) the data were reanalyzed 
by means of a 3 (question, picture, both) x 2 (before, after) x 2 (practiced, 
non-practiced) x 2 (first paragraph, second paragraph) repeated measures 
analysis of variance. The first two factors were between Ss while the 
latter two were the repeated measures. An inspection of the significant 
Scales X Paragraph Location interaction (F=22,66, df=l,l^, p<,00l) re- 
vealed that P items were recalled better than NP items regardless of 
their location in the text although the advantage was greatest when they 
were derived from the first paragraph (Figure 3). A significant Position 
X Paragraph L ocat ion interaction (f=6.U8, df=l/U8, p ^.05) revealed that 
recall for criterion questions (both practiced and non-practiced) derived 
from the second paragraph was higher for those who received the adjunct 
aid after the relevant passage over those who received it before. There 
was no such difference when the criterion question was derived from the 
first paragraph (Figure U), 

Since the Position x Paragraph Location and Scales x Paragraph 
I^ocation interactions were significant but the second order Position x 
Scales X Location interaction was not, it was decided to analyze this 



latter interaction separately. Specifically, it was thought that the seconi 
order interaction my have turned up non-significant because the Position x 
Paragraph Location interaction was sisnificant with P items and non- 
significant with NP items. Consequently, two additional three factor 
MOVA^s were run, one with NP items, on^ with P items as the dependent 
measure. 

The results of these two additional analyses were precisely in agree- 
ment with the above hypothesis (Figure 5), With P items as the dependent 
measure, the Position x Paragraph IxDcation interaction was highly signifi- 
cant (F=9,98/ df=l/i+8, p<.005) but was non-significant with items as 
the dependent measure (F<1, df=l/l+8). An, additional finding from the 
analysis using P items as the dependent measure was a significant Adjunct 
Aid Type x Paragraph Location interaction (F=3.9^^ df=2/i^8, p<,05). Shown 
in Figure 6, it indicates that pictures are least effective as adjunct 
aids when the P item has been derived from the first paragraph and most 
effective when derived from the second paragraph. 

Finally, the time to completion data that was collected from each 
3 was subjected to a one way AI^OVA and Dunnett^s test. Only those Ss 
who were instructed to produce a di*awing after each section of text took 
significantly more time than the control group (p<.05)« 

DISCUSSION 

Of the four hypotheses which were initially proposed, three were 
fully supported. The superiority of adjunct aids appearing after a 
textual passage as opposed to before and the superiority of P items over 
KP items were both demonstrated. These phenomena appear to be rather 
robust as they have been repeatedly obtained with various types of reading 
material and different sets of instructions. Additionally, these effects 
have now been extended to include reader generated pictures. As Table 1 



and Figure 2 reveal, pictures were as effective as questions in facili- 
tating retention. 

The fourth hypothesis was partially supported since only the QA 
group significantly outperformed the control group on P items. This 
hypothesis was based on the following rationale: ^s who received the 
adjunct aid before the relevant portions of text would be forced to guess 
at the correct response and would probably guess wrong. However, they 
would then be cued in to the portion of text associated with the adjunct 
aid and upon encountering the item again in the criterion test could more 
easily retrieve the appropriate material from memory to correctly answer 
the question. Although it is possible that being forced to offer an 
incorrect response interfered with Ss ability to later retrieve the 
appropriate information, the QB and PB groups narrowly missed exceeding 
the critical value for the Dunnett's test. On the other hand, S_s who 
received the adjunct aid after text were expected to outperform the con- 
trol group due to the review function of the adjunct aid. That is, it 
was assumed that the adjunct aid would force to review what he had 
Just read in order to correctly respond to the adjunct aid. As was 
indicated, onJy the QA group significantly outperformed the control. 
Perhaps these effects will increase over a longer arA :^cre difficult 
reading passage. 

The inclusion of two groups that received both a direction to draw 
and a multiple choice question was made to determine if the two adjunct 
aids would exhibit additive effects. Although this turned out not to be 
the case, a slight celling effect In the criterion scores was apparent 
indicating the material was not sufficiently difficult to reveal any 
additional variance that may have been present. A replication of this 
study with either more dlff icu3.t material or younger S^s is needed before 



emy definitive statements can be made regarding the additivity of adjunct 
aids. A replication may also further clarify the present findings com- 
paring pictorial aids with written aids. Given a reading passage that 
could potentially produce more varian'je, it would be interesting to see 
if pictixres produce a stronger mathemagenic effect or if they act at the 
same level as questions as they did in the present study. 

If it can be assumed that presenting adjunct aids before text 
serves an arousal function as the work of Berlyne (1965) suggests, thex* 
the significant Position x Scales interaction indicates that, with the 
type of adjunct aids used in this studj^, arousing a reader's curiosity 
before reading a textual passage is an effective strategy for inducing 
him to learn the material that bears directly on the question or the 
direction to draw but is less effective regarding information in the 
passage that is not related or is incidental to the adjunct aid. Use 
of adjunct aids in this fashion encourages the reader to employ a very 
narrow and specific information processing strategy. This is not 
necessarily detrimental but needs to be considered in conjunction with 
instructional objectives. 

The analysis of the question location data was rather interesting 
and will be discussed in terms of an information search emd processing 
model originally posited by Cunningham and Keller (I972). Briefly, the 
current version of this model states that where adjunct aids precede 
text segment.^ it is assumed Ss enter the aid into memory and initiate 
rehearsal so that it will be available in memory when S turns to the 
text and begins reading. Reading is viewed as an information search 
activity where the reader scans for information which will confirm or 
disconfirm his response to the adjunct aid. Material not relevant to 
the search will receive less attention and presumably less processing. 
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In treatments where adjunct aids follow text segoaents S is assumed to 
read and incorporate as much of the material a he can so that it will be 
available in memory when the adjunct aid is encountered, S could then 
retrieve the appropriate information to meet the demands of the adjunct 
aid. 

?whis model leads to several expectations for both P and UP retention. 
Where adjunct aids precede text^ P items derived from the first paragraph 
should be beti er recalled than P items derived from the second paragraph 
due to the decreased amount of intervening material between the aid and 
knowledge of correct results. Conversely^ where adjunct aids follow 
text, P items derived from the first paragraph should be less well re- 
called than P items derived from the second paragraph for the same rea- 
son, Thj^ Implies a disordinal interaction betijeen adjunct aid position 
and location, As Figure 5 shows, this effect was obtained. 

The data for NP retention agree with previous research (Cunningham 
and Keller, 1972) with the exception that NP retention is not higher 
overall when it appears before than when it appears after P content. It 
had been assumed that when S^s in the QB, PB> and BB groups encounter P 
content in the first paragraph, they would nut be likely to continue 
reading caa*efully the !NP content, hence recall it less well. That this 
di^ not occur may indicate only that the Ss found the reading materials 
interesting and did not narrow their attention to the P content. Infor- 
mal student comments about the reading materials has been generally very 
favorable \7bich lends some credence to this reasoning. 

Taken as a whole these data extend the potential range of adjunct 
aid from entirely verbal, to a combination of visual and verbal. Both 
types seem to operate comparably and both types seem consistent with the 
model of prose learning proposed by Cunningham and Keller (1972). 
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Unfortunately, there have been few attempts on the part of those iiiter- 
ested in prose learning to explore the implications of jointly employing 
both types of stimuli so that even tentative generalizations cannot yet 
be drawn. One extension currently being pursued is the effect of ques- 
tion and imagery adjunct aids on parallel concrete and abstract passages 
with adolescents. It is hoped that these efforts will stimulate other 
reseai'chers to consider the use of non-verbal stimuli or processes within 
a prose learning setting. 
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TABLE I 

Mean Performance for Main Effects of l^rpe, Position 
and Scales for Analysis without Control Group 



Type of Adjunct Aid 


Position * 


Scales-"^^ 


Question 


Picture 


Both 


Before 


After 


Practiced 


Non 
Practiced 


15.72 


15.61 


15.72 


15.07 

_ — . 


16.29 

1 


17.59 


13.77 



*P<.05 
**p<.001 




Figure 1. Interaction Between Adjunct Aid Position and Scales 
for Analysis Without Control. Group 
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Figure 2, Interaction Between Type of Adjunct Aid and Scales for 
Analysis with Control Group 
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Figure 3. Scales x Paragraph Location Interaction 
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Figure k. Position of Adjunct Aid x Paragraph Location 
Interaction 



ERIC 



P Items 
Q KP Items 



10 

9 
8 

7 

6 

5- 
U- 

3 
2 
1 

0 




♦After 

efore 
^ After 

_Q Before 



1st 
Paragraph 



2na 
Paragraph 



Figure 5. Position of Adjunct Aid x Paragraph Location Inter- 
action for Practiced and Kon-Practiced Items 




Figure 6. Type of Adjunct Aid x Paragraph Location Inter- 
action for Practiced Items 



